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Haptic computer input defvice eg for virtual reality 







(57) Typically for use in Virtual Reality computer software applications, the invention provides a hand-held 
haptic computer input device comprising a body (1) grippable in the palm of the hand of a user and a front 
panel (4) contactable by the fingers of the user at points A, R, C D. The outer meriibrane of panel (4) is 
resiliently flexible and at each of points A to D covers a respective pressure transducer actuator fabricated 
from a resiliently flexible or elastomeric material. Each actuator is arranged so as at least in part to be flexed or 
compressed relative to the body (1) by pressure applied by the appropriate digit of the user. The arrangement 
provides that deformation of an actuator by movement of the appropriate digit and the resultant electrical 
transducer output are both generally In proportion to the magnitude of the pressure applied. 
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HftPTIC CXJMf ITlifaH INPOT DEVICE 

This invention relates to catputer input devices generally and more 
particularly but not exclusively to a haptic (xniputer input device adc^^ted 
to be gripped in the palm of a hand of a user and having 'data' input means 
operable by the fingers and/or thunb of the hand typically for use in 
cxHijunction with virtual reality ccnputer software appi 1 nations. 

In the field of virtual reality ccnputer sinulation the increased 
resolution of grE^hics in Hodel space, i.e. that viewed in the virtual 
world, which can be manipilated in real time has resulted in a 
proliferation of man-machine control interfaces. Such interfaces are 
typically known as HCI's - Human C3cnputer Interfaces. For manipulating the 
caricature of a hand in model space hitherto it has been suggested that an 
Bd in the fom of a exo-skeleteil glove be used. Such gloves require 
sensors to determine the relative digit position as well as spatial 
position means to monitor the position of the hand relative to a fixed 
datum. 

Spatial position sensing means can be provided by transmitter or 
receiver means of known type, l^pically, in glove type HCI's a housing for 
these mecUis could be provided disposed adjac^t the back of the hand. If 
wcist flexure is sUso being measured then these means could alternatively 
be disposed adjacent the wrist. 

Olte remainder of the glove houses a multiplicity of input sensors 
to monitor finger and/or joint uuvet t mit such as those v^iich rely on hand 
manipulation affecting the transmission path between lED's and associated 
photodetectors. Exanples of such sensors are described in European Patent 
Specification No 0 211 984. Another suggested way of measuring finger 
ncwatent hy joint flexure is to fit the glove with tendon like linkages 
between fixings one side of a given joint and a respective strain gauge or 
rectilinear operable transducer (e.g. LVDT - linear Variable Differential 
Transducers) anchored at the other side of said joint. In yet another 
suggested way the strain gauges form part of elongate tendrils each 
attached over a joint of the hand to fonn a 'gonicmeter' ad^yted to measure 



jolot cteflection. 



All of the a&iTGmBntdjoned glove t^pe 'data' input devices are both 
buU^ and gsierally difficult to don and doff. Alsor their use prohibits 
free novernent and flexure of the hand resulting in a sanewhat restricted 
feel to the user. This is liJoely to ixpact on the perceived realism of the 
manipulation of a hand-shaped or grabber-shaped cursor in ncdel space. To 
enhance realism it is often necessary to include pressure feedback insans in 
the glove to provide the user with seme degree of concrete feel idien an 
abject in model space is contacted by the virtual hand/cursor. Typically^ 
feedback can be provided by electrical solenoids or by inflatable b l adder s 
disposed in the glove along the underside of the fingers^ for example. 

The inventor has appreciated that devices of the af orerosntioned 
type rely on flexure of the hand to be mimicked directly in model space. 
However, it is well known that the brain is able readily to observe and 
oaqprehend hand manipulation \Avsa traxislated into a different form of 
notion, for example as may occur in the operation of a joystick or steering 
\idheel. It is this human ability to provide visual feedback vdiich the 
inventor utilises in the subject invention. 

It is an object of the invention to provide ccnputer 'data' ii^jut 
means assocdated with the hand of a user \dilch overccmes sons of the 
disadvantages of the af orenentioned glove type oonstructlons and vdiich 
utilises the innate human abill^ to accept the translation of one type of 
hand manipulation into another type of motion in 'reality', i.e. in virtual 
reality a^jpUcations said another type of motion may be visible in model 
space and perceived to be real. 

According to a first aspect of the invention a hand-held hE^rtuc 
ccnputer input device corprlses a botfy grippable in the palm of the hand of 
a user, a pressure transducer attached to the body and a manually operable 
actuator for the pressure transducer fabricated fron a resiliently flexible 
or elastcmeric material, the actuator being arxanged so as at least in part 
to be flexed or ccnpressed relative to the body by pressure ^plied by a 
digit of a user gripping the body, and the arrangement providing that 
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def aniErtujon of the actaatar hy l u uvaubaiL of the digit and the resultant 
eleg*^"^T transducer out^jut are both generally in pccfxartion to the 
neg n lt^y^*^ of the paressure applied. The actuator way be integral with the 
pressure transducser oar may be sqiarate fron and disposed adjacent the 
pressure transducer. 

Preferably, the actuator is provided hy a fluid filled enclosure 
ccnmmicating with the pressure transducer and may be a section of 
resilient tubing attached to one side of the boc^. 

Typically, the body is provided by a housing having a rigid oack 
wall adapted to seat against the palm of a user and a rigid front wall 
aHa phpH to extend behind the fingers of the user, with the front wall 
having a recessed fonnatioa in \ghich the section of tubing can seat and the 
housing further ooonprising a flexible outer rasntxtrane adap^pd to extend over 
at least a part of the front wall to cover the tubing sidewall. 

The pressure transducer may ccnprise a force sensing resistor 
having a polymer surface coated with interdigitating electrodes and a 
semiccHiductar coated polymer substrate. Alternatively, the pressure 
transducer may be a pneumatic/hydraulic pressure transducer and one end of 
the tubing is ccomected so that its interior connunicates with the 
transducer and the other end is plugged. And the transducer may be 
retained within the housing adjacent the back joaH, said one end of the 
section of tubing is connected to a pipe connector which extends frcm the 
chaniaer of the housing into the recessed fonnation, and a generally 
inextensible, i.e. non-inflatable, section of pipe extends between the 
connector and the transducer. The said pipe oonnector may be in the form 
of a T-jcdnt providing a ri^it-angled fluid passageway and a blind linnb 
tdiich can be used to plug one end of another section of tubing. 

Preferably, a plurality of transducers and associated actuators are 
provided with each actuator being flexible or carpressible hy a respective 
digit of the user. A thunb operated electrical switch and/or a thmrb 
operated track-ball may be attached to the body. The body my ccnprise a 
main base portion vdiich houses said transducer(s} and actuator(s) and a 



plug detachable upper cxowd pooctim housing said switch and/or track-ball. 
TtiB body may further ocnpcise a transmitter or a receiver of spatial 
position sensing means. And a retaining strap may be attached to the bod/ 
which is adaptpd to extend aroond the back of the hand of a user gripping 
the body* 

Pressure feedback means associated with the or each actuator to provide 
\dien desired increased resistance to ccnpressibilil^ or flexibility may be 
provided* 

Acxxsrding to a second aspect of the invention a virtual reality 
conputer system ccnprises a CPU, a video display and/or head mounted 
display and haptic device in accordance vdth the af orementianed first 
aspect of the inventian, \dierein in use proportionate ccnpcession or 
flexure of a given one of the actuators is exhibited in the 'vixtuEil world' 
as progressive moveansnt of the correspanding part of a cursor displayed in 
the f am of a representaticm of a human hand or grabber so that slight 
ccBpocession or flexure results in sli^t relative mGrvement and maximum 
ccnpression or flexure results in maxinum relative n i wta a en t of said 
r^xresentation* 

Errhndiments of the invention will now be described by way of 
exanple only and with reference to the aoocnpanying drawings in which:- 

Eigure 1 is a front view of a hc^xtic ccnputer input device in 
aooordance with the invention; 

Figure 2 is a top view of the haptic input device shown in Figure 

1; 

Figure 3 is a right hand side view of the h^jtic inpat device shown 
in Figure 1; 

Figure 4 illustrates diagranmatically the internal structure of the 
h^jtic input device oriented as shown in Figure 3 and in accocdaiKre with a 
first enbodiment of the invention,^ and 
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Elgare 5 is a view similar to that of ELgure 4 MAisxein the h^itic 
ii^Mt device is shown diagrammtinRlly in aocxanJance with a second 
erfxadiment of the invention. 

Both the illustrated enixxiinnants are each in the f onm of a h^itic 
ccnpnter input device ^^ p^prf to be grd^iped in the palm of the hand of a 
user and having 'data' input means cperahle by the fingers and thunb of the 
hand, nhe erabodiments, as shown in Figures 1 to 3, each canprise a body 
having a moulded plastics housing 1 in two^)arts lA, IB fixed together by 
iDsans of pegs 2 (see Figure 4), Olhe body further ccnprises a plug 
detachable cxown partion 3 and front panel or portion 4. OSie housing i has 
a back wall 5 which seats in the palm, a cxown face 6 against ^diich the 
portion 3 seats, cable cannecticn port 7 and retenticn fooonaticos generally 
denoted 8 (shown in detail in Figure 4) . 

In the first enixximBnt, the internal structure of is 
illustrated in Figure 4, Electrical oonnectar block 9 is fixed within the 
housing 1, Connectoo: block 10 is aligned with crcwn face 6 Ti*en front 
portion 4 is fixed relative to the housing !• Block 9 is samfeiched 
betsaeen fonnations on three of the pegs 2 when the two parts 1A,1B of the 
housing are fixed together, A cable loan 11 extends throo^ port 7 to 
provide electrical ccnnecticn between the blocks 9,10 and associated 
cccputer hardware (not shown). A circuit board 12 plugged into connector 
block 9 has mounted thereon four pressure transducers 13,14,15,16 and 
associated electrical circuitry. Each of these transducers, typically 
being fxieumatic car hydraulic pressure transducers, is adapted to provide an 
electrical output in prcpartion to the fluid pressure to \irfiich it is 
subjected. Ol^pically and desirably, this output is linear, i.e. 
proportional to the input pressure, althou^ the output may not always be 
so. i^:propriate calibration of the coipiter haxdMare win facilitate the 
use of transducers having a non-linear output. 

A front face to the housing 1 is provided by portion 4 vdiich is 
adapted to extend behind the fingers of a user and vrfiich at its upper and 
lower extent is held CE^ytive by the respective formation 8 v^en the twD 
parts of the housing 1 are fixed together. The portion 4 has a rigid wall 
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17 beiving a profile to facilitate being clanped b/ the fingers of the user. 
This wall 17 defines an elGiigate recess into which sections 18,19,20,21 of 
resilient tubing are seated. A plurality of T-joint pipe connectors 
22,23,24,25,26 extend throu^ the wall 17 vdth their respective T crossbar 
lying lengthways in the recess. 

Each T-joint pipe connector 22 to 26 has a blind linb 27 of the T 
crossbar with the reanaining liubs providing a respective ri^it-angled fluid 
passagetray. Ibe sectioD 18 of tubing corresponding to the little finger is 
attached to oonnectar 22 at one end and plugged by the bliiKi lini) 27 of 
oannector 23 at the other. Similarly section 19 extsids betweCTi oonnectars 
23,24; section 20 extends between connectors 24,25, and section 21 extends 
between oannectors 25,26. It will be appreciated that the blind linib of 
oonnectar 22 and the fluid passageway of connector 26 are redundant. 
Consequently, connectors 22 and 26 could be replaced respectively by a more 
^)propciate pipe connector and plug. 

Relatively inextensible pipes 28,29,30,31 extend respectively 
betwaen connectors 22,23,24,25 and transducers 13,14,15,16. Consequently, 
the interior chancers of tubing sections 18 to 21 ccnnunicate with an 
associated transducer 13 to 16 and the output frcm each of these 
transducers relates to the pressure applied to the corresponding section of 
tubing. Thus, sections 18 to 21 are each an actuator for the associated 
transducer 13 to 16. 

Front portion 4 of the body further oonprises a flexible mendbrane 
cover 32 extending gaierally parallel to the irall 17. The menbrane 32 
extends over and encloses the sections of tubing 18 to 21 and pipe 
connectors 22 to 26. ^e inenhrane 32 is sufficiently flexible to permit 
ccnpression of the sections of tubing 18,19,20,21 fcy the li^it plication 
of pressure by fingers of the user at positions A,B,C,D respectively shown 
on figure 3. 

Hva T-joint connectors 22 to 26 are generally rigid, consequently 
the membrane 32 is only corpressible therebetween thus defining 
locations/positions A,B,C,D for the fingers of the user. Suitably, the 
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body is constructed so that it wiU acoaranodate use hy pec3ple of different 
hand size and finger reach. If desired the noibcane 32 ney be nculded so 
as to provide indentations carresponding to locatixans A,B,C and D to enable 
ready location of the fingers of the user. 

Crown partion 3 of the body is suitably fitted with a track-ball 33 
\Aich internally of the portion 3 is provided with a oonnector 34 plugable 
into the connectotr block 10 of the main housing 1. Additional retention 
neans my be provided to «isure that the crown portion 3 remains fixed to 
the housing 1. It will be appreciated that interchangeable crcwn portitHis 
3 BBcy be provided. Par exanple, a crosim partion having switches in place 
of or together with the tradHaall 33 could be used. Biese are disclosed 
in detail in our co-paKiing UK Patent J^licatiOT filed this date with the 
title "Versatile Thunb-Cantroll able Haptir Ccnpiter Input Devix:e" 

In additicai to the afocedescribed 'data' input means, the housing 1 
is provided with retentic© means for a position sensor 35 v*ich may 
conveniently be the transmitter or receiver of a position sensing device, 
rchus, the ccnpiter hardware receives input frcm the fingers and thunb of 
the user whilst being able to mMiitor the relative spatial position of the 
hand. 

Ohe internal structure of the second entxdimmt^ which is 
illustrated in Figure 5^ is generally si milar to that of the first 
edbodiment (shown in Figure 4) and like numerals denote like or 
functionally similar parts. In this enbodimMit the aforedescribed 
hydraulic/pneunatic pressure transducers 13 to 16, sections of tubing 18 to 
21 and associated connecting/fixing means of the first enbodiment are 
replaced by a different transducer technology, namely foroe sensing 
resistor (FSR) technology. 

T^ically, such technology utilises ESR's each in the fom of a 
two-ply polymer laminate in which an outer polymer surface layer coated 
with interdigitating electrodes is attached to a semiconductor coated 
polymer stdbstrate. T5ie resistance of the substrate ply is dependent on the 
pressure applied to the polymer surface layer- 
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In the secxsnd enbodbnent FSR's are dlagrasiiELtically illustrated in 
figure 5 and nmrbeEed (40A,40B) , (41A,41B) , (42A,42B) and (43A^43B) - \*ece 
'A' denotes the substrate and 'B' denotes the gaierally resiliently 
flexihle polymer surface layer. It will be ^^areciated that such ESR's can 
be considerably thinner than illustrated herein, Consecpieiitly, in the 
constructioii illustrated in Figure 5 it would be possible to interpose 
between the elastcneric menbrane 32 and thinner FSR's actuators each in the 
form of a foam or elastcroeric elsn^t, or a sectim of small bore 
resiliently coipressible tubing. 

The ESR's 40,41,42,43 are connected respectively by way of 
electrical wLring 44,45,46,47 to the electrical circuit board 12 and via 
cable locm 11 to the ocnputer hardware. The arrangement enables the 
resistance change of the FSR's under applied pressure to be measured and 
calibrated. With ^fpropriate circuitry on circuit board 12 eetch ESR can 
function as a separate pressure transducer. Besilience of FSR's 
themselves provides that finger novemsnt will be in p roport i on to ^plied 
pressure vhilst the provision of the elastcmsric meirbrane 32 enables that 
mcrvement to be greater than if pressure were ^plied directly to the ESR's. 
In this etribodiment the actuators of the ESR's can be viewed as either the 
integral surface layers 40Br4lB^42B,43B respectively, the respective 
overlying regions of the menbrane 32, or a ccxobination of both. 

Functionally, the two aforedescribed enixxiiinsnts are essentially 
the same. In both cases pressure e^lied to the menbrane 32 at positions 
A,B,C,D (sham in Figure 3) will result in a corresponding electrical 
'output' respectively from transducers 18 to 21 or 40 to 43 and mofvemsnt of 
nsdbrane 32 in proportion to the pressure applied. 

Ihe aforedescribed Pirhndiments are particularly useful \Aien used in 
association with a virtual reality ccnputer programne e^lication in which 
a cursor in the shape of a hand or grabber is controlled in model space. 
The cursor can be provided with four digits controllable by the user 
gripping the housing 1 with each digit cQmespcnding to a respective on& of 
the user's fingers, i.e. ccmtrolled by actuators at or associated with 
positions A,B,C,D. 



Applying a given pcessure to one of the posiUons A,B,C,D will 
result in an electric3al signal frcm the associated transducer vrfiich in turn 
leads to correspondiiig nDvement of the associated di^t in model space. An 
increased pressure would result in greater movement and conversely a 
U^iter pressure would result in less mDvenent. The user advantageously is 
able to sense a certain degree of feedback fron the actual movemKit of 
their own digits as well as the pcessure ajpfilied. 

Obviously, the grip wiU vary from user to user and ccxisequently it 
would be possible to introduce a bias into the circuitry so that the input 
device could be custatdsed for different users. Rar, exanple in 
enbodijients using a coipressible tuhingr or other like bladder , means could 
be provided for increasing the pressure within the tubing so that a greater 
pressure is needed to effect conpression thereof. Also, it may be 
desirable to introduce feedback means to alert the user to contact of 
digits of the cursor with an object in model space- 
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CEAIMS: 

1. A hand-held haptic ccnputer input desviee carpadsing a bcxiy 
grif^jable in the palm of the hand of a user, a pressure transduoer attacdied 
to the body and a manually operable actuator for the pressure transducer 
fahcioated fron a resiliently flexible or elastoneric material, the 
actuator being arranged so as at least in part to be flexed or conpressed 
relative to the bod^ by pressure applied by a digit of a user gripping the 
body, and the arrangenEiit providing that defonnatian of the actuator ty 
iKWCTent of the digit and the resultant electrical transducer output are 
both generally in propartion to the magnitude of the pressure applied. 

2- A he^Jtic device in accordance with claim 1, vterein the actuator is 
integral with the pressure transducer. 

3. A hfy^-^*^ device in acooEdance with claim 1, wherein the actuator is 
separate fccm and disposed adjacent the pressure transducer, 

4. A haptic device in accordance with claim 1, vAierein the actuator is 
provided by a fluid f-ill*^ enclosure ccninanicating with the pressure 
transduoer. 

5. A haptic device in accordance with claim 3 or claim 4, wherein the 
actuator is a section of resilient tubing attached to one side of the bocty. 

6. A haptic device in accordance with claim 5, vrtierein the body is 
provided by a housing having a rigid back \rall adapted to seat against the 
palm of a user and a rigid front wall ad^jted to extend behind the fingers 
of the user, with the front wall having a recessed fonnation in which the 
section of tubing can seat and the housing further coiprising a flexible 
outer roearibocane adapted to extend over at least a part of the front wall to 
cover the tubing sideurall- 

7. A bap^-if! device in accordance with any one of the preceding claims, 
wherein the pressure transduoer ccnprises a force sensing resistor having a 
polyner surface coated with interdigitating electrodes and a semiconductor 
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coated polymer substrate. 

8. A haptic device in accstsrdanoe with claim 6, wherein the pressure 
transduoer is a pnsimatic/hydraulic pressure transducer and one end of the 
tubing is connected so that its iiiteriar cciniinucates with the transducer 
and the other end is plugged. 

9. A haptic device in aooacdance with claim 8, wherein the transduoer 
is retained within the housing adjacent the back waU, said cue end of the 
section of tubing is connected to a pipe oonnectar which extends fran the 
chanter of the housing into the recessed fonnatioo, and a generaUy 
inextensible section of pipe extends between the cosnnector and the 
transducer. 

10. A haptic device in aacocdanoe with claim 9, \diereiii the pipe 
oonnectar is in the form of a T-joint providing a right-angled fluid 
passagewEcy and a blind linb \9bls± can be used to plug one end of another 
section of tubing. 

11. A haptic device in accordance with any one of the preceding claims, 
vdierein a plurality of transducers and associated actuators are provided 
with each actuator being flexible or ccnpcessible by a respective digit of 
the user. 

12. A h^Jtic device in accordance with any one of the preceding claims, 
further conptising a thunb operated electrical svdtch and/or a thunto 
operated track-ball attached to the body- 

13. A hsp tir device in accordance with claim 13, idierein the body 
ccnprises a main base portion which houses said transducer(s) and 
actuatQr(s) and a plug detachable tapper crown portixm housing said switch 
and/or track-ball - 

15. A hc^Jtic device in accordance with any one of the preceding claims, 
wherein the body further emprises a transmitter or a receiver of spatial 
position sensing means. 
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16. A h^Jtic device in accordance with any one of the preceding claijiB, 
wherein a retaining str^ is attached to the body \i*icdi is adapt-pd to 
extend around the back of the hand of a user gripping the body. 

17. A bap*-ir^ device in accordance with any one of the preceding claimsr 
further ccnprising pressure feedback means associated with the or each 
actuator to provide ^dien desired increased resistance to ccmpressihility or 
flejdbility- 

18. A virtual reality ccnputer system conprising a CPU, a video display 
and/or head mounted display and a haptic device in accordance with any one 
of rilaimR H to" 17, **ereiQ in use proportionate ccnpression or flexure of 
a given one of the actuators is exhibited in the 'virtual world' as 
progressive n o v enient of the oorresponding part of a cursor displayed in the 
form of a representation of a human hand or grabber so that slight 
ccnpression or flexure results in sliest relatUve movement and maximum 
ccnpression or flexure results in nBximam relative movement of said 
representation ■ 

19. A hand-held haptic ccnputer ii^t device for virtual reality 
applications substantially as hereinbefore described and as illustrated in 
Figures 1,2,3 and 4, or Figures 1,2,3 and 5 of the aoconpanying dravdngs. 
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